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ABSTRACT 


It  is  shown  that  simple  eiqenvalues  of  an  m-t  h ordet 
ordinary  differential  equation  are  approximated  within 

0(  j A | ) by  collocat  ion  at  Gauss  points  with  piecewise 

v. 1 

polynomial  functions  of  deqree  • mtk  on  a mesh  A . The 
same  rate  is  achieved  by  certain  averaqes  in  case  the  eiqen 
value  is  not  simple.  The  arqument  relies  on  an  extension 
and  simplification  of  Osborn's  recent  results  concern inq 

the  approx  imat  ion  of  eiqenvalues  of  compact  lineal  map- 
, l (t  Jo«  <.  t c t .u  i • * f , v k L /.I  t <’  ^ j ' « 
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Significance  and  Explanation 


Collocation  at  Gauss  points  has  become  a popular  method  for 
the  solution  of  boundary  value  problems  for  ordinary  differential 
equations,  both  linear  and  nonlinear.  It  is  therefore  natural  to 
. onsidei  the  method  for  the  solution  of  the  corres{'ondinq  eigen- 
value | toblem.  Put  , theory  and  numerical  experiments  reported  in 
the  1 itet at urc  left  open  the  quest  ion  of  just  how  well  eigenvalues 
would  It  approximated  by  this  method.  That  is,  proven  convergence 
i.ite:  wi-i  e much  lower  than  one  would  hope  for  or  could  demonstrate 
in  egteful  numerical  experiments.  The  present  report  settles 
the  i'  quest  ions  by  proving  optimal  convergence  rates  for  the  method. 
The  argument  required  a reworking  and  strengthening  of  the  existing 
the  i for  the  approx imat ion  of  eigenvalues  of  compact  linear  maps. 


collocation  approximation  to  eigenvalues 

OK  AN  ORDINARY  DIFFERENTIAL  EQUATION : 
THE  PRINCIPLE  OK  THE  THING 


Carl  de  Boor  and  Blair  Swartz 

0.  Introduction.  The  eigenvalue  problem  we  consider  is  of  the  form 

(1)  (Mx)  (t)  = \(Nx)(t)  for  t < [0,1],  6.x  = 0 , i = 1 , . . . ,m  , 

l 

(itt  ) 

where  (\,x)  , (E  * C [0,11  is  being  sought  and 

(2)  (Mx)  (t)  :=  (Dmx)  (t)  + }’  a.  (t)  (DXx)  (t) 

i<m 

(Nx)  (t)  :=  ) b.  (t)  (Dix)  (t.) 

. ‘ l 

m l<m  (m-1) 

with  (6^)^  a sequence  of  linear  functionals  on  C [0,1] . 

We  approximate  this  problem  by  col loeat ion , as  follows.  We  choose  a (strict)  parti- 
tion A :=  (t  )^  of  [0,1], 

0 " fco  < < S " i ' 

kJ 

and,  based  on  it,  a sequence  ( t J ^ collocation  points,  k to  each  interval 

It  , t 1 , 

r r+ 1 

(1)  r,  . :=  (t  tt  , + p At  )/2  , i = 1 , . . . , k , 

kr+i  r r+1  i r 

k ♦ - 

with  UO  ^ a fixed  sequence  of  points  in  the  "standard"  interval  |-1  ,1  ].  Then,  we 

seek  \ t (T  and  x r IP  :=  S’,  , n C ^ [0,1]  satisfying 

A A k+m , A k+m , A 

(1  ) (Mx.)(t.)  = X (Nx  ) ( r ),  i = l,...,k(,  6.x  =0,i~l,...,m. 

A A 1 A A i i A 

Here,  IP  . consists  of  all  functions  on  [0,11  which,  on  each  interval  [ t . , t . ], 

r , A i i+  l 

coincide  with  some  polynomial  of  order  r , or , of  degree  < r . 

In  this  paper,  we  bound  the  difference  between  the  eigen  element  (\,x)  and  its 

collocation  approximation  (\  ,x  ),  as  a function  of  the  maximum  mesh  | A | : max , At . , 

A A 11 

k 

the  ascent  of  \ , and  the  choice  of  the  collocation  pattern  (p  ) . In  particular, 

w<‘  show,  in  Theorem  1.1,  that 


\ ♦ (’(  A ) 


in  case  \ lias  ascent  1 and  (»■<.)  ^ are  the  Gauss-Legendre  points.  We  also  show 
that  it  is  not  (xjssible  to  obt.ai,  this  result  as  an  application  of  Osborn's  111]  general 
theory.  Kurt her,  we  show  that  (4)  holds  also  when  \ lias  ascent  greater  than  1 


provided  \ is  replaced  by  an  average  of  certain  nearby  approximate  eigenvalues.  We 
A 

also  obtain  (1(|,\|*'")  approximations  to  breakpoint  values  of  the  eigenvector  x . 

Sponsored  1<y  the  United  States  Army  under  Contract  No.  PAAG2h-7'i-c-0024  and  by  the 
United  States  Department  of  Energy  undet  Contract  No.  W-740S-I’ng.  16. 
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Here  is  an  outline  of  the  paper.  In  Section  1,  we  identify  collocation  as  a par- 
ticular projection  method  applied  to  the  eigenvalue  problem 

ATy  = y 

for  a certain  compact  linear  map  T on  an  appropriate  Banach  space.  In  Section  2,  we 
apply  Osborn's  nice  results  to  this  projection  method,  indicate  that  one  cannot  obtain 
(4)  in  that  way,  but  defer  a proof  of  this  claim  to  Section  4.  We  then  modify  Osborn's 

analysis  appropriately  in  order  to  relate,  in  Theorem  2.2,  the  error  A-A  to  numbers 

A 

of  the  form 

< (T-T  )*>  ,**  >, 

A A 

* 

with  \f  ^ an  approximate  (generalized)  eigenvector  and  a (general  ized)  eigenvector 

of  the  adjoint  problem.  In  Section  3,  these  numbers  are  shown  to  be  ()(|a|^^)  for 
collocation  at  Gauss  points,  which  leads  to  (4).  Section  3 also  contains  a short  dis- 
cussion of  related  results. 

We  have  deferred  discussion  of  numerical  examples  to  a companion  paper  [3] . We 
found  only  one  real  example  of  an  ordinary  differential  equation  with  an  eigenvalue 
of  ascent  greater  than  one  in  the  literature.  Yet,  existing  theory  (and  the  theory 
developed  in  the  present  paper)  give  convergence  results  which  strongly  depend  on  the 
ascent.  The  three  examples  we  give  do  show  that  the  proven  convergence  rates  cannot 
be  improved.  We  also  offer  an  explanation  of  sorts  for  the  curious  way  in  which  approx- 
imate eigenvalues  have,  in  some  examples,  been  observed  to  converge  to  an  eigenvalue 
of  ascent  greater  than  one. 

In  the  process  of  writing  the  present  paper,  we  have  reexamined  the  at  times 
convoluted  arguments  in  de  Boor  and  Swartz  [2]  for  the  superconvergence  of  Gauss  point 
collocation  approximations  at  knots.  This  has  led  us  to  a whole  family  of  projectors 
onto  which  interpolation  at  the  Gauss  collocation  points  is  only  one 

example,  which  all  lead  to  0(|a|^^)  approximations  at  knots  and  therefore  give 
0(  | A | 2k)  approximations  to  simple  eigenvalues.  We  discuss  these  ideas  in  (4),  where 
we  also  give  an  alternative  proof  of  Theorem  3.1  which  makes  no  reference  to  the 
arguments  in  [2] . 


thr  setting  of  Osborn  [11],  Vainikko  [12]  et  al. , i.o.,  as  a problem  of  approximating 
the  eigenelemont s of  a compact  map  T on  some  Banach  space  Y , and  therefore  assume 
that  0 is  not  an  eigenvalue  of  (0.1)  and  that  the  coef f icients  of  M are  continuous 
(later,  we  will  assume  them  to  be  quite  smoot h) . Then  M * exists  as  an  integral 
operator  on  Y : » n,  [0,1] , 

(1)  (M~ly)(t)  - f1  G ( t , s ) y ( s)  ds  , 

0 

with  G Green's  function  for  the  problem 

(Mx)  (t)  ■ y(t)  for  t , [0,1],  tvx  ”0,  i - l,...,m. 

Further,  (\,x)  is  an  eigenelement  of  (0.1)  if  and  only  if  (l/\,Mx)  is  an  eigen- 
element  of  the  compact  linear  map 

(2)  T :=  N M_1 

on  Y [0,11.  Note  that  T is  given  as  an  integral  operator  with  a piecewise 

cont inuous  kernel  T , 

m-1 

(')  Ht.s)  :=  j b.(t)  lVn>iG(t,s)  , 

i=0  1 

therefore  compact  as  a map  from  H, , into  C . In  fact,  T maps  n,^-  bounded  sets 
to  uniformly  l.ipschitz  continuous  sets. 

Such  a change  transforms  (0.1^)  into  the  problem  of  finding  (\^,y^)  < I ' 
such  t hat 

y ^(  i . ) \ ^(Ty  s)  ( t . ) , i = 1 k <, 

with 

(•l)  V :=  [Mz  : z i irm  , , , (J,  z * 0 , i = 1 , . . . ,m ) . 

.\  rn-f  K » A i 

We  convert  t h i • into  an  ordinary  eigenvalue  problem  involving  some  opera! ei  T on  Y 

by  introducing  the  linear  projector  P^  whicli  carries  C^[0,11  (:  Clt^.t^l  ' ... 

' P[t  ,t  ]l  into  V by  associating  with  each  y , C [0,1]  the  unique  element 

P y ■ V ^ for  which 

(P  ,y)  ( i . ) - y ( i . ) , i - 1 , . . . , kC . 

A l l 

Then  the  two  conditions:  f , V and  f ( l .)  = g(i.)  , i 1 kf,  are  equivalent  to 

Ail 

t h«  vine  condition  f p ^q . The  approximate  eigenvalue  problem  (0.1^'  is  theiefoie 
equivalent  to  the  problem  of  finding  ( \ ^,y ^)  < T ' Y such  that 


-3- 


(M 


V ■=  \ T v 
yA  A AyA 


with 

(o)  T :=*  r,T  . 

A A 

Of  course,  it  is  not  clear  a priori  that  P^  is  even  defined.  But  note  th.it  , by 

definition,  P.y  is  the  unique  element  in  V.,  i.e.,  of  the  form  Mx . with  x.  < B\" 

A A A A ktm,.. 

and  >;^x.  0 , i = 1 , . . . ,m  , which  agrees  with  y at  the  i.'s,  According  to 

Theort'in  3.1  of  de  Boor  and  Swartz  [2],  there  exists  a positive  const  depending  on  M 

(and  p)  so  that,  for  all  partitions  A with 
I A I :=  max  . At . < const. 


r i 


-M 


and  all  y t C 10,1],  the  collocation  equation 

(Mx  ) ( t . ) » y(i.),  i = l,...,k«,  F.x  =0,  i = l,...,m, 

A 1 1 1 A 

has  exactly  one  solution,  x , in  I'”'  . (To  be  precise,  de  Boor  and  Swartz  [2] 

A k+m , A 

assume  additionally  that  (p.)™  is  linearly  independent  over  IT  , but  this  assumpt  ion. 

ll  m 

w.i.  shown  to  bo  superfluous  by  Wittenbrink  [16].  Also,  both  papers  only  consider  real 
valued  functions,  but  the  extension  to  complex  valued  functions  is  trivial.  Wittenbrink1:; 


formulation  would  also  appear  to  be  appropriate  for  problems  in  which  the  also  depend 

on  \.)  This  insures  that  P^  is  defined  for  all  A with  | A | sufficiently  small, 

and  al lows  us  to  conclude  from  [2]  that  P ^ converges  to  the  identity  pointwise  on  C|(',l 

In  fact,  if  (tO,  is  linearly  independent  over  I'  = ker  pm  , then  P 
i 1 m A 

( P*"m  S V(pmM  with  p the  linear  projector  taking  pmx  to  pmx^  and  shown  in  (.'] 

to  he  bounded  on  Cl  0,1]  independently  of  A ; hence  P^  is  then  bounded  on  C' 1 0 , 1 1 inde- 
pendently of  A . In  the  more  general  case,  an  argument  like  Wittenbrink * s (see  lie; 
proof  of  Theorem  2])  shows  that 
(7) 


11(1  - P.)yl!  - const  II  (1  - 0 .) nmM_1yll 
A <" *A  ' < 


for  sitne  const  independent  of  A and  with  interpolat ion  from  IP^  ^ at  the  colloca- 

te ion  i'll  i nts  ( i ) ^ . 

In  conclusion,  not  only  is  P^  defined  for  all  small  | A | , but,  since  T maps  11, 
compactly  into  C , we  have  T^  - P T defined  and  uniformly  convergent  to  T as  1 > o 


-4- 


2.  A general  result. 


In  this  section,  we  recall  Osborn's  results  and  then 


rephrase  his  arguments  to  obtain  a simple  yet  useful  formulation  of  the  error  in  eigen- 
value approximations  by  projection  (and  other)  methods.  This  formulation  makes  it  evident 
(as  Osborn's  or  Vainikko's  does  not)  why  eigenvalue  approximations  by  collocation  are  of 
such  high  order. 

We  recall  from  Osborn  [11]  (or  from  a standard  reference  such  as  Kato  [8])  that, 
associated  with  each  nonzero  eigenvalue  y of  a compact  linear  map  T on  the  Banach 
space  Y is  the  invariant  subspace 

(1)  S :=  ker  (y  - T) a, 

i.e.,  the  kernel  or  nullspace  of  the  linear  map  (y  - T)a,  where  a , the  ascent  or  rank 
of  u , is  the  smallest  integer  for  which  ker(y  - T)  a = ker(y  - T ) a+  ■*■ . s j.s  finite 
dimensional,  say 

a :=  dim  S =:  algebraic  multiplicity  of  y , 

while  the  geometric  multiplicity  of  y is  the  number  g :=  dim  ker(y  - T) . The  elements 
of  ker(y  - T)\{0}  are  the  eigenvectors  of  T , while  those  of  S\ker(y  - T)  are  called 
root  vectors  or  generalized  eigenvectors.  S is  the  range  of  the  linear  projector  E 
given,  e.g.,  by  the  formula 

(2)  E :=  ~ f (z  - T)_1dz  , 

2tti  Jr 

with  T any  circle  in  the  complement  of  the  spectrum  of  T and  enclosing  in  its  interior 
y , but  no  other  eigenvalue  of  T . The  linear  projector  E can  also  be  written  in  the 
form 

* 

(3)  Ey  = I ( y,*>  >^>  , 

i=l 

sl  . * a 

with  (^  any  basis  for  S and  (^)^  the  corresponding  dual  basis  in 

* * rv 

S :=  ker (y  - T ) , 

* * * * 

i.e.,  >p  ^ e S , all  i , and  ^ = » all  irj-  Here,  T is  the  (Banach)- 

★ 

adjoint  or  dual  of  T , i.e.,  the  linear  map  on  the  topological  dual  Y of  Y which  is 
characterized  by 

* * * * * 

< Ty,  y > = < y,  T y > , all  y e Y , y e Y , 

it  * 

and  ( , ) denotes  the  natural  pairing  between  Y and  Y . In  particular,  S is  the 
invariant  subspace  of  T corresponding  to  y and  has  also  dimension  a . 

-5- 


li\  terms  of  this  not  at  ion , Osborn  [11]  establishes  (among  otheis)  the  following  farts. . 


L 


Thr.'i  ,-in  ! uv.K't!1.'  let  tr  ' a cguenc*  oi  compact  l iiu-at  mar.  on  the  Banach 

space  v converging  uniformly  to  the  lineal  mar  t , and  let  •„  be  a (nonzero)  eigen- 
value of  T . Then , for  all  largo  v, 

(41  K : * ~t  J (i 

v l 


- T )‘ld= 

V 


is  defined;  its;  range, 


, has  dimension  a and  satisfies 


(5) 

with 

(fd 


gap(8,  s ) ' const  II  (T  - T ) j II 

v — v 1 s 


gapd1  ,V) 


max  . sup 
I x,  V 


d X St  (x 

II  X II 


dist  (x,u)  ^ 

siup  -■  ‘ . 

X,  V 


fui  t hei  , l t i s one  Oi  t !u 

(71  ! u — u | - const  (II  (T-T  1 I Jill  (T  -T  ) I 

V 1 8 v s 


eigenvalues  of  T one lossod  bv  1',  then 

,i 

V 


* ♦ 


However , the  average 


i » j l 


|(  (T-T  ,0  . > i 1 . 

v i .1 


( i.  * ...  * 1 /a  , 

1 a 


comprisied  of  the  a eigenvalues  ot  T (counting  algebraic  multiplicities)  enclosed  by 
I',  admits  the  closer  estimate 


(81 


I li-ii  ! ■ const  (II  (T-T  ) | .11 II  (T*-T* ) I .11  1 V |<  (T-T  )>'  ,0*  >ll  . 

- v s v S . • v i i 

i - 1 

This  is  a powerful  theorem,  and  Osborn  makes  good  use  of  it  in  a variety  of  applica- 


tions described  at  the  end  of  his  [vipot  , mostly  to  daleikin  approx imut ions . but  the 
theorem  does  not  suffice  to  explain  the  high  accuracy  of  eigenvalue  approximat ions  obtained 

by  collocation.  The  chief  difficulty  lies  in  the  fact  that,  in  collocation  (as  translated, 

* . 

in  the  preceding  section,  into  this  abstract  setup),  T does  not  approximate  V 
sufficiently  well,  see  Sect  ion  •!. 

We  obtain  more  direct  control  bv  comparing  matrix  represent.it  ions  for  t|  and 

' 8 

T j , as  is  done,  in  etteot  , in  Osborn  [111  to  get  t he  estimates  ("l  and  (8'  , and  is 

V ' 

V 

done,  quite  explicitly,  in  Atkinson  [1]  and  in  Kreiss  1°];  but  we  do  it  a little  bit 
d i f f erent ly . 

bet  d be  the  matrix  represent  at  ion  of  t|,  with  respect  to  the  basis  (c.'"1  toi 

8 i l 


8 . Since  gap ( 8 , 8 > * 0 , r i is  1-1  for  all  large 

V 1 h 

V 

responding  basis  (*b  )‘j  for  8 with 


, and  then  theft'  is  a 


L 


( 9 ) E y . = V.  , i = 1 , . . . , a . 

1.  v 1 

* * 

Since,  by  (3)  , v ^ = vVE  , we  see  that 

( v*  . , v . ) = ( E I'f  ■ ) = ( V . ,>£  . ) = £ . • 

i.v  ? i,v  ] 13  13 

* 

lienee  y - ' ( y , > v" . for  all  y t S , thus  the  matrix  representation  J for 

1 1 1 , v v v 

T i with  respect  to  (v?.  )f  lias  (i,j)-entry 

vis  1 , V 1 

v 

* 

(J  ) . . = < T v-  . ,v'.  > , i , j = 1 , . . . ,a  . 

v 13  v 3 ,v  1 

But  the  entries  of  J are  given  by  a similar  expression.  We  have 

★ * * * 

(J)  . . = < TV  . . > = < TEy- . ,<r  . > = < ETV  . ,*.>=<  TV  . .v"  . > , 

13  31  3, vi  3, vi  3, vi 


i,  j = 1 , . . . ,a  , 

using  the  fact  that  T commutes  with  its  spectral  projector  E . Consequently, 

. * . 

(10)  II J - J II  < const.,  „ max  < (T-T  )>p  , ,*p , > . 

v — *11  . . v 3,v  1 1 

1.3 

We  qather  these  facts  into  a theorem  . 

Theorem  2.2 . With  the  assumptions  and  notations  of  Theorem  2.1,  let  J be  the 

matrix  representation  of  t|  with  respect  to  some  basis  (*" . ) f of  S . Then,  T | 

* — S * 1 1 — v S 

\ 

is  s imi lar  to  a matrix  close  to  J in  the  sense  that 


(it) 


(J  - J ) . . = ( (T  - T )v*  . > , i,  j = 1,  . . . ,a  , 

v 1 3 v 3 , v 1 


with  (c  ),  the  basis  for  S for  which  Ev? 
1 , v 1 v 


* 

V.  = * . , all  j , and  (y\), 

3 , v 3 1 1 


the  basis 


for  S dual  to  (^ . ) f (and  to  (v? . ) f)  . 

1 1 1 , v 1 

Tt  follows  that  the  eigenvalues  of  T close  to  11  are  those  of  the  matrix  J 

v v 

(including  algebraic  multiplicity  and  structure)  and,  since  J has  u as  an  eigenvalue 
in  just  the  same  way  as  T does  (including  algebraic  multiplicity  and  structure),  the 
approximation  properties  of  the  process  can  be  read  off  from  standard  perturbation  argu- 
ments which  compare  the  eigenvalues  of  a matrix  J with  those  of  a perturbation  J , 
e.g.,  from  Wilkinson  [1?1,  in  the  manner  practiced  by  Atkinson  (1]  and  Kroiss  [91  . 

In  part icular , 

(12) 


u - u . < const  II J - J I 

1 i 1 - v 


1/n 


for  any  of  the  a eigenvalues  iu  o*  , while 


j 
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(13) 


I U - (trace  J ) /a  | = (trace;  J - J ) |/a  < const  II  j - j || 
v v — v 


and  also 

(14)  1 1/p  ~ (trace  J ^J/a]  < const  II J - J II  . 

v — v 

In  fact,  with  the  eigenvalues  of  counting  algebraic  multiplicities,  and 

a the  elementary  symmetric  functions  in  a variables,  we  see,  by  comparing  co- 
efficients of  the  characteristic  polynomials  of  J and  J , that 

v 

(ir>)  a.  (u  ) = o.(p,...,p)  + 0(llJ  - J II),  all  j . 

j J-  a j v 

Finally,  with  g the  geometric  multiplicity  of  p , there  exists  an  eigenvalue  p.  of 

J (and  T ) so  that 

v v 

(i€>)  p = p.  + put  j - j n9//a)  . 

1 V 

This  is  a better  rate  than  (12)  except  when  all  Jordan  blocks  of  J have  the  same  size. 

The  estimate  (16)  appears  in  Wilkinson  [13,  p.  81],  while  (13),  (14)  and  (15)  are 
obvious.  The  proof  of  (12)  (via  Gershgorin's  circle  theorem)  is  left  to  the  reader  in 
Wilkinson  [13,  p.  80-81].  Atkinson  [1]  gives,  so  he  says,  a shorter  proof.  We  record 
our  own  version,  for  the  record. 


Since  ( p - J)  = o , 

|p-Pi|a  < II  (p-Jv)a|l  = IKp-j^)01  - (p-j)a||  < const||Jl[  |(J  II j-j  || 

a ' v v 

using  the  fact  that  the  map  A A is  locally  Lipschitz  continuous.  (indeed, 
a-1  , _ , a-l 

A1  - Bl=  l A X ( A-B)  B^  , hence  IIa“  - Ba)|  <_  [ J II  All  a~^ _1||  Bl|  ^ ] II  A-Bll  . ) This 

3=0  j=0 

proves  (12),  given  that  J -+  J . 

v 

Note  that  we  recover  (7) -(8)  of  Osborn's  theorem  directly  from  (12) -(13)  because 
of  (10)  and  since 


(17) 

while 

(18) 


(J  - Jv>..  - (IT  - Tv)(E|s  > 

V 

= < (e|  ) ^ , (T-T  )%>.  > + ( (T-T  )y.,v'*), 

lsv  3 3 vi  v 3 i 


(El  ) \>-*ll  <111  - Elldist((E|  f\ff,  ran  E) 

v lsv 

< 111  - Ell  const  II  (T-T  ) I HU  ||  , 
— v S 


the  la  it  by  (5)  and  because 


v . 


Here 


II  (eL  ) **ll  < constIMI  for  all  sufficiently  large 
I v 

we  have  used  the  facts  that  (El  ^ ~ (1~E)  (E I ) y , and  that  E is  a linear  pro- 

1 v 1 v 

jeetor  onto  S , hence  ||(l-E)v||  < ||  1 — K||  dist  (v,S)  while,  for  v , S , dist  (v,S)  • 

— v — 

gap(S,S  )l!v||  . 

v 

It  remains,  for  any  particular  approximation  sequence  (T  ),  to  estimatt  II j - j II  , 
i.e.,  to  estimate  expressions  of  the  form 

(19)  < (T-T  ) (EL  f > , 

V b 

* » v 

with  V c S , y i S . The  estimate 

(20)  II J - J II  < constll  (T  - T ) I II 

V — V I S 

is,  of  course,  immediate  from  (17)  and  (18)  and  provides,  in  conjunction  with  (12) -(1C)  , 
first  assurance  that  the  eigenvalues  of  T are,  indeed,  approximated  well  by  those  of  T . 

It  also  makes  the  important  point  that  the  error  in  the  eigenvalue  approximation  achieved 
by  a particular  discretization  method  is  at  least  of  the  same  order  as  the  error  in  the 

corresponding  discrete  solut ion  of  the  corresponding  nonsingular  equation.  Hut,  this  estimate 

* 

ignores  the  fact  that  the  linear  functional  <c  is  being  applied  to  a residual  error,  i.e., 

to  an  element  of  the  form  (T  - T )y,  a fact  that,  at  times,  leads  to  sharper  estimates. 

tor  example,  assume  that  is  obtained  from  T by  projection,  i.e.,  T P T fot  some 

projector  P . Then,  as  in  (17)  and  (18) , 

|<  (T-T  ) (EL  )_1y  ,/  > | 
v S 

v , , -1  * * 

(21)  = < (E  ) ,<p  (1-P  ) T > + ( (1-P  ) TV"  , y'  (1-P  )> 

S v v v 

v * , 

- const  II  (1-P  ) II  ||(  1-P  ) *H  II  'r  II  II  y”  II 
v Is  V |S 

2 

(using  the  facts  that  (1-P  ) = (1-P  ) and  that  TS  c S) . This  provides  an  indication 

of  the  potential  "double  accuracy"  in  the  eigenvalue  approximation  by  such  methods,  as 
first  proved  by  Vainikko  [12],  and  also  established  in  this  generality  by  Osborn  111]. 

In  the  analysis  of  Galerkin’s  method,  or  the  least-squares  method,  v S is  given 
by  integration, 

( f '*f  > = /y"  (s)f(s)ds 

* * 

for  some  smooth  function  <y  , while  ran  P^  , i.e.,  the  interpolat ion  conditions  for  the 
projector  P^  = P^  , consists  of  integration  against  certain  piecewise  smooth  functions.. 
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Explicitly,  thou 


* It  ft  „ 

distil  , ran  P ) = inf  sup  )/  (s)f(s)ds  - / / y.K . (s)  f (s)  ds  I/ll  f II 
A Y f i 1 1 

with  span  (K.)  akin  to  IP  in  approximation  power.  This  allows  the  conclusion  that 

*■  K f A 

iid  - pa)*|s*ii  = c*(  | a ! k> 

for  those  methods  which,  together  with  the  more  obvious  fact  that  11(1  - p^)|sl|  = 0(|A|k), 

gives  the  sought-for  "double  accuracy"  for  such  methods. 

★ ★ 

For  collocation,  though,  dist(sP  , ran  P ) fails  to  go  to  zero  with  any  kind  of  rapid- 


ity since  now 


* * 

dist  (y0  , ran  P ) 
A 


inf  sup  | j ip  (s)f(s)ds  - ) y.f(i.)  | /II  f II  , 
y f i 1 1 


i.c.,  ran  P ^ consists  of  linear  combinations  of  certain  point  evaluations.  Therefore, 
the  simple  bound  (21)  only  implies  0( | A | ^)  convergence  for  Gauss  point  collocation.  Even 
Osborn's  more  careful  bound  (8)  only  implies  CH  | A ) ^ m)  convergence  for  Gauss  point  collo- 
cation, with  m the  difference  between  the  order  m of  M and  the  order  N (see  Section 
4.) 


Because  of  this,  we  proved  Theorem  2.2  which  relates  to  error  in  the  einenvalue 
approximation  to  the  value  of  a smooth  linear  functional  on  the  residual  error  in  a collo- 

i 1 2k 

cation  approximation.  For,  such  expressions  can  be  shown  to  be  0 ( | A | ) , as  is  done  in 

the  next  section. 


-10- 


For  collocat  ion,  as  dosci  ibed  in 


-i  - a*  Appl  icat  [i  «■  a^JVuntji^. 

« 

t lio  inti  oductory  sections  0 and  1 , the  quantities  < (T-T  )*•  , ,y-  > in  the  niui.il 

v j , v l 


bound  (A .10)  take  the  f ontv 

(U  f'  v'*(»  ) (T  -T  ) v , ,(t)dt  , 

0 1 A J'A 

2 k 

and  we  now  intend  to  show  these  to  be  ('( | A | ) if  the  collocation  points  are  chosen 

as  Gauss  points,  i.e.,  if  C ^ ) j consists  of  the  k zeros  of  t he  hegondro  polynomial 
ot  degree  k . The  analysis  of  collocation  at  Gauss  points  in  de  Hooi  and  Swat  t ;•  |,'| 
was  l tast'd  on  t he  observat  ion  that 

(A)  /'  V * ( t ) (T-T  ) y*  ( t ) dt  - (A  ( | A | *' K ) 

0 A 

* 

in  case  v*  and  <f  are  both  rniooth.  But,  since  (1)  involves  y*  . rather  than  a I i xed 

I # 

< we  have  to  make  more  explicit  lust  how  (A)  depends  on  *'  and,  because  of  out  desiie 
to  keep  our  estimates  mes h independent  , i.c'.,  dependent  only  on  tin'  numbei  |,\|  , the 

arqument  is  a bit  delicate. 

We  continue  to  use  the  notation  and  terms  or  the  preceding  section,  but  replace  the 
subscript  "v"  by  t he  more  appropriate  subscript  "A".  Also,  we  use  the  abbreviations 


(r)  ‘ 


and 


sup 

t • t • t , 
r rt  1 


it) 


Mls,(r) 

: ~ 

)'  llb'yll 
i-0 

(r)  • 

Km  t hot  , 

wr  .is? 

mine  that  (p. 

ik 

i 

has  been 

chosen  so  t hat 

l t) 

/'  p(t) 
-1 

k 

II 

i - 

( t - e, ) dt 

1 

0 fi.ii  all  pi  It' 

n 

K i na 1 1 y , 

wr  asj- 

ainii'  t li.it  ! tit' 

t t i c i ent  s 

of  M and  N ate  smooth 

enough . Spec i - 1 

we  assume  t hat 

(-11 

.1  , r l'  . f 

l 1 

,.(nt  k)  , , 

t (0,11, 

all  i . 

Then,  Us 

inq  t In 

.it't'i  ov  i .it  1 on 

X<"  : - 

i r 

_ ( r — 1 ) . 

- r [o 

,11  : P*  f abs . cont  . , I 

'*  f . X), 

with  X 

any  ot 

t In-  •■.pares 

nV 

10,11,  1 

1 P ' Ot  c|0,ll  , t he 

-1 

map  M call  u 

..it'  , ( i i ml  ( rt  ml  , ( 1 1 1 1 

k into  x , and  N maps  X into  X , f ot  t • ntk.  In  particular. 


any  invariant  sib  pace  of  T belonging  to  a nonzero  eigenvalue  consists  ot  functions  in 
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( n > k ) * 

X , and  the  same  holds  for  T , the  adjoint  of  T . This  insures  that 

(5)  ScC(n+k),  S*LC(n), 
and  implies,  with  (1.7),  that 

(6)  II  (1  - PA)  III  = 0(  | A | k>  . 

A I S 

j. 

In  particular,  ||J  - J ^|l  = (1(|a|  ) , by  (2.20),  and  (2.12)  now  gives  the  results  of 
R.  Winther  [14)  for  collocation. 

We  also  conclude  from  (6)  and  (2.18)  that 

(7)  II  ( K ) ^y-yll  = (?(  | A I K)  llyll  for  y e S . 

S CXI  1 1 

V 

Lemma  3,1,  There  is  a constant  const  depending  only  on  k and  p so  that 

If  r+l  v"  (T-T.)y.  | < const  | At  |n+k+1||y  II  , Jl  (T-T . )y  .11  . 

ij  A A1  — r'  n,(r)  A A n+k,(r) 


Proof.  The  function  (T-T.)y.  vanishes  at  the  k collocation  points  r . ...... 

-=- — A A rk+1 

i in  [t  ,t  ] and,  by  assumption  (3),  the  polynomial  H (t  - p , ) is  ortho- 

rk+k  r r+l  c r rk+s 

g 

gonal  to  JP^  on  [t  ,t  ] . T^1£>  argument  in  de  Boor  and  Swartz  [2],  in  the  proof  of 

* 

Theorem  4.1  (with  y playing  the  role  of  G(t,*))  therefore  establishes  the  inequalit 

assuming,  of  course,  that  y < 4.^  [t  ,t  ,]  and  (T-T.)  y . t ]L^n+k^[t  ,t  ].  ||| 

* r r+l  A A 00  r r+l 


Next,  consider  ||  (T-T  )y  II  , . with  y = <f>  . . = (El  ) y . 

AAn+k,(r)  A 3, A |S^  3 


We  would  like 


to  bound  this  number  in  terms  of  y.  and  its  derivatives  on  (t  ,t  , ) , and  this  seem 

j , A — r r+ 1 

difficult  since  T ^f  at  a point  depends,  offhand,  on  f on  all  of  [0,11.  But , 


T y 
A 


■ = J (J.)  . 

) ,A  A i]  1,1 


since  J = (( T 

(8) 

we  have 


A 3, A”  i 


. ) ) represents  T 


AS, 


with  respect  to  (y . ).  Therefore,  with 

1 , A 


X , 

: = M y , , 

IE  , 

, i=l , . . . ,a , 

1 » A 

i.A 

m+k , 

A 

(T  - 

T ) y . . = Ty. 

j 

(J,)..y.  . 

A 3 » A 3 

» A 

i 

A 13  i , A 

= NX. 

y 

(J  ) , .Mx.  , 

3 

» A 

L 

i 

A 13  if  A 

shows 

the  derivatives  of 

(T 

- T )y , to  be 

A 3 , A 

and  J ^ ► J . Th 

of  the  derivatives  of  the  coefficient  functions  of  M and  N (it  is  only  here  that  we 
use  the  full  power  of  our  assumption  (4))  and  those  of  x . . D'™  , and,  us 

* 0 A K + In  f /) 


-12- 


*J  (by  (2.20)),  it  follows  that 


ll(T  - T.)*.  .11  . . , > < const..  max  II  x . .11  , . 

A j,An+k,(r)  M,N  1,4  m+k,(r) 

To  complete  the  analysis,  it  remains  to  bound  II  x . ^11^^  appropriately. 

Lemma  3.2.  For  <e  < S and  x :=  M V , let  x :»  M V.  and  <fi , : { K I ) V . 


Then,  for  s=0,...,mtk  , 


lDSxH (r)  + const^ ( | A 1/ | At ^ |)k 


Proof . By  (7)  , llv’^-V’ll^  = 0(  | A | ),  hence 
(11)  llDS(x  - x)  II  = 0(  | A | N for  s=0,...,m, 

which  proves  a stronger  inequality  than  (10)  for  s=*0,...,m.  For  s ">  m , one  now 

proceeds  as  in  the  proof  of  Lemma  4.1  in  de  Boor  and  Swartz  [2)  (with  the  role  of  x 

and  Kx  played  here  by  x and  x^  , respectively)  to  show,  using  (11),  that 

llDS(x  - x,)ll.  . < const  ( I A I / 1 At  |)k  for  s mtl,...,mtk  , 

A (r)  — x 1 1 1 r 1 

in  case  x , n/m+n^  [t  ,t  ,].  But,  by  (4),  x = M V has  oven  m»k*n  continuous 
tu  r r+ 1 

derivatives. 

Thoorem_3_j_L . Let  T be  the  compact  linear  map  on  B..,  [ 0 , 11  cji von  by  ( 1 . .’ ) , with 

M and  N g iven  by  (0.2)  and  satisfying  (4),  and  let  )i  bo  a nonzero  eigenvalue  of  T 

with  corresponding  invariant  subspace  S . Let  be  the  colloc.it  ion  approx  im.it  ion 

(1.6)  to  T , and  assume  that  the  collocation  points  ( p . ) satisfy  ( t)  . 

For  all  sma  1 1 | A | , T has  an  invariant  suhspace  and  a mat  i ix  lvpi  osent  at  ion 

J . of  T . I for  which 

A — AS,  

' A 

II J - J^ll  <_  const  |A|nf^  , 

with  J an  appropriate  matrix  representation  for  T | ,.  . 

Proof.  By  Theorem  2.2,  we  only  need  to  show  that  the  integrals  in  (2)  are  (-'(|a|,HS 
under  our  assumptions.  But,  by  Lemmas  3.1  and  3.2  and  (S), 


If  VT  - Vial  i £ I r'V’-V'i,, 


r t 


< ) const  | At  |n+,l+l|H£.l|  . . II  (T-T  )<f  II 

— ' 1 r1  l n,(r)  A A,j  n+k,  (r 


} const  | At  |nfk4l|l^.ll  , . max  ( II  x II  . . + ( I A I /At  ) kl 
'•  1 r'  i n,(i)  1 mtk,(r)  11  r 


< const  A 
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Kor  comp let  oncss , we  summar  i r.e  previous  results  concerning  the  approximation  of 
eigenvalue  problem-  (o.l)  l>y  collocation.  Winther  1141  was  the  first  to  publish  results 
for  the  collocation  cf  (0.1)  using  1’™*^  , . He  proved  that  (t)ie  quantity  he  called 

"algebraic  multiplicity"  we  have  called  "ascent") 


'v  - VA!  <-'<  I A I ’*>  , 


a t he  ascent  of  X ; 

II  r ‘ (u  - u ) II  0(|A|k),  * 1.  m ^ u = 1 . 

In  one  of  his  numerical  experiments,  he  collocated  at  t tie  k Gauss  points  even  though 
his  t heory  no  longer  applied.  Hut  this  experiment  demonstrated  that  s;we  sort  of 
"superconvei qence"  might  he  going  on  for  the  approximate  eigenvalues,  alt  hough  its 


character  could  not  be  estimated.  In  his  thesis  1 1 S ],  Winther  proved  that,  usin  j 0' 


k*m , ‘ 


inst ead , 


' - Cl | A J 


(ktmin (n ,m) ) / 
llD1(u  - u )llv  <?(  | A | 


V 

ktm  in  (n  ,m) 


or  = ascent  of  A ; 


) , i < m-m  ; 


IIP  (u  - Vi  ) II 

A “ 


I ,l  k+m  in (n ,m- i ) . 

0(  I A | ) , in-m  < l < m-1  ; 


these  last  assuming  that  a 1.  Extensive  numerical  work  reported  there  also  indicated 
that  some  sort  of  superconvergcnoe  was  taking  place  for  t he  approximate  eigenvalue:;  wlien 
Gauss  points  were  used  in  t he  collocation.  t.athrop  [10]  presented  some  more  numerical 
evidence  of  superconvergence,  for  two  second  order  operators;  but  still  the  character 
of  the  sviper convergence  could  not  be  estimated.  Cerutti  and  Parter  [6)  contemplated 
collocating  the  self-adjoint  second  order  eigenvalue  problem  (P~u) (x)  la^lx)  u(x) 


with  k Gauss  points  using 


Convergence  rates  were  not  relevant  to  that 


k+2,  A 

paper;  what  is  worth  noting  is  their  proof  that  the  approximate  eigenvalues  of  the  non- 
self-adjoint matrix  problem  were,  in  fact,  real. 

In  their  monograph  [71  concerned  primarily  with  collocation  using  piecewise  poly- 
nomial:;, Pouglus  and  Pupont  steered  clear  of  straightforward  collocation  for  the  eigen- 
value problem.  However,  they  did  use  Bramble  and  Osborn's  precursor  (M  to  Osborn's 

p 

basic  paper  [11]  to  prove  that  for  the  second  order  problem  Mu  Xu  and  using  D’* 

K*  •-  r A 

one  can  collocate  the  orthtxjonal  projection  of  the  right-hand  side  onto  D'  at  the 

K t A 

Gauss  points  to  obtain  (they  suppose  that  t he  ascent  of  \ is  one) 
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|x  - \A|  - 0<|A|2k), 

11  u ■ Vo  ■ (1<Nk+2>.- 

max  In1 (u  - u ) (x  ) | - 0( | A|2k)  , i - 0,1  . 

j 3 

From  t,u'  start, our  numerical  experiments  indicated  quite  clearly  that  straight- 
forward collocation  of  (0.1)  at  the  Gauss  points  using  IP™  , should  yield  (at  least, 

in  f A 

when  t he  a seen t of  \ is  one) 

|X  - XA|  - (>(  I A 1 2k)  ; 

max  |Di  (u  - u^)  (x^)  | - (l(|A|2k),  i <m  ; 

i.e.,  about  the  best  one  could  hope  for  from  the  known  results  for  the  boundary  value 
problem  12].  It  war.  these  experiments,  of  course,  that  prompted  us  to  develop  this 
paper  which  completes  Winther's  work. 


-IS- 


* »)*■  -v^oint  problem  is  not  approx  imated  all  that  Wt.n . , 

• cvtiun,  we  elaborate  on  our  earlier  contention  that  Osborn's  bound  (2.B) 


is  not 


:t  rotwl  ''1KHK,t'  to  lJ  iVt‘  idle  desired  Of  | A I**1)  bound  for  the  eigenvalue  error  in 


uu  collocation.  The  difficulty  lies  with  the  term 


II  (T*  - T*)  L*l 


whveh,  so  wo  claim,  cannot  be  shown  to  be  t1  ( | A | k)  merely  because  S*  is  a finite 
dimensional  lineal  space  of  smooth  funct  ion(al)s. 

we  Km  in  with  a simple  bound  on  (T*  - T * ) I * which  has,  in  fact,  nothing  to  do 

* 

w 1 r •'  i'"t  merely  relies  on  the  obvious  fact  that 

* * * • 


II  (T  - T > I ,*ll  v || t' 

|S 

1 oi  this,  lot  in  be  the  difference  between  the  order  m of  M and  the  order  of  N 


TnII  = II T - T II 


<-’) 


1 emm.i  -1 .1  . I'ndet  the  assumptions  of  Theorem  3.1 , 

II T - T v)l  = cMIaT  ) . 

S£oof.  For  ft  1.,  , we  compute  with  (1.3)  that 

(T  - T ) f * /l  (l  - p )T( *,s)f (s)ds. 


1 m t her , by  1 1 . ')  and  >ecause  of  the  smoothness  assumption  (3.4),  l(-,s)  < l/m'[0,l] 


uniformly  in  s , i.o.. 


II  nmT(  • ,s] 


const 


M,N 


for  0 


V S s 


Conseguent ly , from  (1.7), 


II  (l  - P^)  T(  *,s)|| 


■oust 


M,N 


and  u’l  tollows.  On  combining  (2)  and  (1),  we  then  obtain 


( t) 


(T  - T ) ,.ll 

A S 


0(|Af)  . 


w*'ich  allows  the  conclusion  from  that 

<•»'  lid  - dNll  Cl  | A | k+TS  , 

a result  already  in  Winther  [15]  . 


Next,  we  show  that  (3)  is  sharp  in  tho  sense  that  we  cannot  obtain  a rate  better 
than  Ct  | A |m>  if  all  we  know  about  S is  that  it  is  spanned  v t nut  • main  -smooth 
funct  ion(al)  s.  For  this,  we  exhibit  a simple  M,  N,  (t-'  ' ^ , A anil  a vers  nv  ot  ; „■ 

for  which 


* 

We  take  > 


Then 


II  (T  - T^)i£  II  ■ const  | A | *”  . 

1 , i.e.  , 

<f  f = jl  f (tldt  , all  f <.  I,.,  . 

0 2 


l (T*  - = fl  /(t)  J1  (1  - p ) T(t  ,s)  f (s) ds  dt 

‘ 0 0 A 

- f1  ( /l  (1  - P )T(t,s)]dt  f (s) ds  , 

0 0 

and,  consequently, 

(41  II  (T*  - T*)<MI  = II  f1  e(t , *)dt  II  . 

A 0 2 

with 

e(  • , s)  :=  (1  - p ) T( • , s)  . 

A 

Next,  we  choose  M = Dm,  N = nm'"n'  and  any  appropriate  (6.1™  independent  ovei 

U'  . Then,  for  some  appropriate  p < IP  , 
m r fs  m 

7(t,s)  = N [ (t-s)n'~1/(m-l)  1 -p  (t)  1 
t + s 

= (t-s)™  V(m-l)  ! - q (t) 

▼ s 

for  some  appropriate  q^  < TP^  . Also,  is  then  iust  C ^ , i.e.,  int erpolat  ion 

k( 

from  at  the  collocation  points  (i J . Therefore,  with  the  assumption  that 

k v m , 


e(*,s)  = (1  - Qf)  T0 ( • , s ) 

where 

TQ(*,sl  :=  (•  - si™  1/(m-l) ! . 

Further,  c(*,s)  ■=  (1  - q ,1T,(*,s)  vanishes  on  every  interval  (t  ,t  ,1  which  does 

.3  0 i i ♦ l 

not  contain  s in  its  interior.  Thus 

1 t 
J o(t,s)dt  = f 1 e(t,s)dt 

0 t. 
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i v t,ut  contains  s . On  this  interval,  we  change  variables, 

using 


Then  wo  can  writ. 


"i(:)  (t,  + tui 4 * &v/2  • 


i ♦ 1 


(t  ,s)dt  / (1  - Q)  T (o.(t),s)  ——dr, 

t _ i u i 2 

l 

Wjth  polynomial  interpolation  to  functions  of  r at  the  points 
m (-1,1).  Since  also,  with 


-1 


(s)  , 


0 i 

we  therefore  find  that 


At.  m-1 

To«-*i<T>  ■ i-yM  (t  - ^"Vfm-ni  , 


, m-l 


< P.  , all 
k 


-I 


/*  e(t,s)dt  = ( 

0 

where  F is  the  function  on  [-1,1]  given 


At  . m 

~ ; /(m-1) ! • F (o) , o = o71(s),  t < s c t 

i i — — i+1 


F ( o)  - 

Jl  (1 

- Q)  ( l 

_ 

o)m~l  d 

-1 

4 

since. 

e.g.  , 

Q(  • - 

-1  = 0 

for 

F(o)  = 

fl  (T 

. m-1 
- c) 

d i 

= (l  - 

e)m 

-1 

4 

Now  combine  (41  and  (rd  to  get  that 

IlFll 


(T 


* . . uni  r c-i 

‘ tak*  r = ( o^TTT  ] J (AV2) 

v ' 1=0 


2lH4  1 


For  a uniform  partition  A = ( i | A J ) ^ , therefore  , 


(b) 


* * * 

II  (T  - T )C  II 


II  Fit . 


which  proves  our  claim. 


(m-1)  i:rt+1/;' 
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